Author : B. Manaswini 1
Date of Publication :15th March 2017
Abstract: Software Engineering is a branch of computer Science which is used for delivering an efficient and reliable product based on the customer’s requirements. Software testing is one of the strategies for identifying the correctness of a program. The conflict arises when a bug is found even after completion of testing. This approach is known as Oracle Problem. A Metamorphic testing (MT) is one of the methods proposed by Chen in 1998 for making the Oracle problem less severe. This MT creates follow-up test cases and compares the output with the original output. If there is no error between the outputs then the test case is correct. If any fault exists between the outputs then a bug is identified and it shows that there is a fault in the given test case. This paper presents survey on metamorphic testing which is applied on various domains in computer science, related applications, and research challenges.
Reference :
-
- T. Y. Chen, F.-C. Kuo, T. H. Tse, and Z. Q. Zhou, “Metamorphic testing and beyond,” in Eleventh Annual International Workshop on Software Technology and Engineering Practice, 2003., Sept 2003, pp.94–100.
- Z. Q. Zhou, D. H. Huang, T. H. Tse, Z. Yang, H. Huang, and T. Y.Chen, “Metamorphic testing and its applications,” in Proceedings of the 8th International Symposium on Future Software Technology (ISFST 2004). Software Engineers Association, 2004.
- T. Y. Chen, J. W. K. Ho, H. Liu, and X. Xie, “An innovative approach for testing bioinformatics programs using metamorphic testing,” BioMed Central Bioinformatics Journal,vol.10,no.1,p.24,2009 .[Online]. Available: http://www.biomedcentral.com/1471 2105/10/24
- Murphy, K. Shen, and G. Kaiser, “Automatic system testing of programs without test oracles,” in Proceedings of the Eighteenth International Symposium on Software Testing and Analysis, ser. ISSTA ‟09. New York, NY, USA: ACM, 2009,pp. 189–200. [Online]. Available: http://doi.acm.org/10.1145/1572272.1572295
- T.Y.Chen, “Metamorphic Testing: A simple approach to Alleviate the Oracle Problem”, 2010 fifth IEEE International Symposium on Service Oriented System Engineering.
- Segura, R. M. Hierons, D. Benavides, and A. Ruiz-Cortes, “Automated test data generation on the analyses of feature models: A metamorphic testing approach,” in Third International Conference on Software Testing, Verification and Validation (ICST),2010, April 2010, pp. 35–44.
- M. Asrafi, H. Liu, and F.-C. Kuo, “On testing effectiveness of metamorphic relations: A case study,” in Fifth International Conference on Secure Software Integration and Reliability Improvement (SSIRI), 2011, June 2011, pp. 147–156.
- H. Liu, X. Liu, and T. Y. Chen, “A new method for constructing metamorphic relations,” in 12th International Conference on Quality Software (QSIC), 2012, Aug 2012, pp. 59–68.
- T. Y. Chen, F.-C. Kuo, D. Towey, and Z. Q. Zhou, “Metamorphic testing: Applications and integration with other methods: Tutorial synopsis,” in 12th International Conference on Quality Software (QSIC), 2012, Aug 2012, pp. 285–288.
- Eleni Giannoulatou, Shin- ho Park, David T Humphreys, and Joshua WK Ho, “Verification and validation of bioinformatics software without a gold standard: a case study of BWA and Bowtie, ,” BioMed Central Bioinformatics Journal,From Asia Pacific Bioinformatics Network (APBioNet) Thirteenth International Conference on Bioinformatics (INCoB2014)
- U. Kanewala and J. M. Bieman, “Using machine learning techniques to detect metamorphic relations for programs without test oracles,” in IEEE 24th International Symposium on Software Reliability Engineering (ISSRE), 2013, Nov 2013, pp. 1–10.
- U. Kanewala, “Techniques for automatic detection of metamorphic relations,” in IEEE Seventh International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 2014, March 2014, pp. 237–238.
- U. Kanewala, “Techniques for automatic detection of metamorphic relations,” in IEEE Seventh International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 2014, March 2014, pp. 237–238.
- Amir Hossein Kamali, Eleni Giannoulatou, T. Y. Chen, Michael A. Charleston, Alistair L. McEwan, and Joshua W.K.Ho, “How to test bioinformatics software?”2014, Online available at http://dx.doi.org/10.1007/s12551-015-0177-3
- T. Y. Chen, “Metamorphic testing: A simple method for alleviating the test oracle problem,” in Proceedings of the 10th International Workshop on Automation of Software Test, ser. AST ‟15. Piscataway, NJ, USA: IEEE Press, 2015, pp. 53–54. [Online].Available: http://dl.acm.org/citation.cfm?id=2819261.2819278
- Michael Troup, Andrian Yang, Amir Hossein Kamali, Eleni Giannoulatous, T.Y.Chen, Joshua W.K.Ho, “A cloud-based framework for applying metamorphic testing to a bioinformatics pipeline”, 2016, 1st International Workshop on Metamorphic Testing, IEEE.
- L. L. Pullum and O. Ozmen, “Early results from metamorphic testing of epidemiological models,” in ASE/IEEE International Conference on BioMedical Computing (BioMedCom), 2012, Dec 2012,pp. 62–67.
- A. Ramanathan, C. A. Steed, and L. L. Pullum, “Verification of compartmental epidemiological models using metamorphic testing, model checking and visual analytics,” in ASE/IEEE International Conference on BioMedical Computing (BioMedCom), 2012,Dec 2012, pp. 68–73
- Mohammad Raunak, Mega Olsen, “Simulation Validation Using Metamorphic Testing(WIP)”,ConferencePaper,2016 publication : http://http: //www.researchgate.net/publication/280567781
- Mohammad Raunak, Mega Olsen, “Metamorphic Validation for Agent-based Simulation Models”, 2016, Conference paper, publication: http://www.researchgate.net/publication/307457899
- Serigo Segura, Gordon Fraser, Ana B. Sanchez, and Antonio Ruiz-Cortes,2016, available at: http://dx.doi.org/10.1109/TSE.2016.2532875
- T.Y.Chen, F.C Kuo,Wenjuan Ma, Willy Susilo, Dave Towey, Jeffrey Voas, Zhi Quan Zhou, “Metamorphic Testing for Cybersecurity”, 2016, IEEE Computer Society